Information processing apparatus, information processing method, and storage medium

ABSTRACT

A control method of an information processing apparatus includes specifying a changed displayed content in a case where a displayed content on a display is changed, and displaying a predetermined item on the display, the predetermined item being an item based on the specified changed displayed content and being an item for performing a predetermined process using at least a part of the specified changed displayed content.

BACKGROUND Field of the Disclosure

The present disclosure relates to an information processing apparatus,an information processing method, and a storage medium.

Description of the Related Art

In recent years, information processing apparatuses including a touchpanel, such as smartphones and tablet terminals, have become widelyprevalent, and a large variety of applications has been executed on theinformation processing apparatuses.

Along with this, various kinds of functions have been executable in theapplications, and it has been becoming a common practice to provide manyfunctions in one application.

As an example of a means for providing functions in an application,there is a means for providing predetermined functions in response touser operations. Japanese Patent Application Laid-Open No. 2019-74948discusses a method for providing functions of deleting and copying aselected object based on the direction of pinch-in (reduction) orpinch-out (enlargement) among touch panel operations. According to thismethod, it is possible to provide functions to the user without alwaysholding a display area for displaying a wide variety of functions.

The use of the method discussed in Japanese Patent Application Laid-OpenNo. 2019-74948 makes it possible to provide a plurality of functions tothe user without displaying a menu in an application.

However, according to the method discussed in Japanese PatentApplication Laid-Open No. 2019-74948, it is necessary to predeterminefunctions to be provided based on the directions of operations, and thusthere is an issue that many functions cannot be provided.

For example, in a case where the user wishes to make red-eye correctionto an image of a person on a screen on which the image of the person anda text are displayed, the user needs to enlarge the image of the person,select the person's eyes, open an image processing menu, and selectred-eye correction. In a case where the user wishes to translate thetext, the user needs to move to the text, select the relevant region,open a translation menu, and select the menu item. These processes willtake the user a great deal of time and effort.

SUMMARY

In view of the issue described above, the present disclosure is directedto reducing the user's time and effort in selecting a desired function.

A control method of an information processing apparatus includesspecifying a changed displayed content in a case where a displayedcontent on a display is changed, and displaying a predetermined item onthe display, the predetermined item being an item based on the specifiedchanged displayed content and being an item for performing apredetermined process using at least a part of the specified changeddisplayed content.

Further features of the present disclosure will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a hardware configuration exampleof an information processing apparatus according to one or more aspectsof the present disclosure.

FIG. 2 is a diagram illustrating an example of a display screen on atouch screen display equipped with a touch panel.

FIG. 3 is a diagram for describing a method for displaying an operationmenu.

FIG. 4 is a flowchart describing an example of a process procedureaccording to one or more aspects of the present disclosure.

FIG. 5 is a diagram for describing a method for displaying an operationmenu in response to a pinch-out.

FIG. 6 is a diagram for describing a method for displaying an operationmenu in response to a pinch-in.

FIG. 7 is a flowchart describing an example of a process procedureaccording to one or more aspects of the present disclosure.

DESCRIPTION OF THE EMBODIMENTS

A first exemplary embodiment of the present disclosure will be describedwith reference to the drawings. The following exemplary embodiments areexamples for describing the present disclosure, and are not intended tolimit the present disclosure to these exemplary embodiments.

A hardware configuration example of an information processing apparatusin the present exemplary embodiment will be described with reference toFIG. 1 . In the present exemplary embodiment, the followingconfiguration is taken as an example. However, the present exemplaryembodiment is applicable to apparatuses having a display unit such as atouch screen display, and is not intended to limit the functions of theinformation processing apparatus to those illustrated in the drawings.

An information processing apparatus 101 includes an input interface 102,an operation unit 103, a central processing unit (CPU) 104, a read onlymemory (ROM) 105, a random access memory (RAM) 106, an external storagedevice 107, an output interface 108, a display unit 109, and acommunication unit 110. These components are connected to one anothervia a system bus.

The input interface 102 is an interface for accepting data input andoperation instructions from a user via the operation unit 103 to bedescribed below.

The operation unit 103 is formed of operators such as a physicalkeyboard, buttons, and a touch panel. The display unit 109 and theoperation unit 103 to be described below may be at least partiallyintegrated, and for example, may be formed so as to output a screen andaccept user operations on the same screen.

The CPU 104 is a system control unit that controls the entire operationof the information processing apparatus 101 such as execution ofprograms and activation of hardware.

The ROM 105 stores fixed data such as control programs and data tablesto be executed by the CPU 104, an incorporated operating system(hereinafter, called OS), and programs. In the present exemplaryembodiment, the control programs stored in the ROM 105 are used toperform software execution controls such as scheduling, task switching,interruption processing, under the control of the incorporated OS storedin the ROM 105.

The RAM 106 is formed of a static random access memory (SRAM) or adynamic random access memory (DRAM) requiring a backup power source. TheRAM 106 may store data by the use of a primary battery for data backupnot illustrated. In this case, the RAM 106 can hold important data suchas program control variables without volatilizing the data. The RAM 106also has a memory area for storing setting information about theinformation processing apparatus 101 and management data about theinformation processing apparatus 101. The RAM 106 is also used as a mainmemory and a work memory of the CPU 104.

The external storage device 107 stores various applications, contentsdata handled in the applications, and the like.

The output interface 108 is an interface for controlling the displayunit 109 to display data and notify the state of the informationprocessing apparatus 101.

The display unit 109 is formed of a light-emitting diode (LED), a liquidcrystal display (LCD), or the like, which displays data or notifies thestate of the information processing apparatus 101. On the display unit109, a software keyboard including numeric input keys, mode settingkeys, confirmation key, cancel key, and power key may be provided toaccept user input via the display unit 109.

The communication unit 110 is configured to connect to an externaldevice and execute data communication.

FIG. 2 is a diagram illustrating an example of a display screen on thetouch screen display 201 equipped with a touch panel according to thepresent exemplary embodiment. The touch screen display 201 displays oneor more graphics in the user interface (UI). In the present exemplaryembodiment, the user makes a gesture on the graphic by using one or morefingers 202 (not illustrated to scale in the drawing), for example,thereby to operate the screen of the application stored in the ROM 105.

The application has a screen such as a setting screen 203. The screenincludes a display area of an operation menu to be described below withreference to FIG. 3 , and can present an operation menu related to auser operation (movement, enlargement, reduction, or the like).

A series of processes of processing to be performed by the informationprocessing apparatus 101 according to the present exemplary embodimentwill be described with reference to the flowcharts of FIGS. 3 and 4 .

FIG. 3 is a diagram illustrating the behavior of the informationprocessing apparatus 101 changing from an operation menu 301 to anoperation menu 302 in response to a user's gesture operation of swipe onthe setting screen 203 with a finger 202 in an arrow direction indicatedby broken lines. FIG. 4 is a flowchart describing a procedure ofprocessing by the information processing apparatus 101 with the behaviorillustrated in FIG. 3 .

FIG. 3 illustrates the operation menu 301 displayed on the screen whenthe user's touch operation is started. However, the operation menu 301is not necessarily required to be displayed.

The process in the flowchart of FIG. 4 is started in response to thedisplay of a specific screen such as the setting screen 203 on anapplication or the OS.

In step S401, the CPU 104 waits for detection of movement of the user'sfinger 202. In a case where the CPU 104 detects the movement of thefinger 202 (YES in step S401), the process proceeds to step S402. Withreference to FIG. 3 , for example, in a case where the CPU 104 detects atouch operation by the user's finger 202 on the touch screen display 201and detects the movement of the finger 202, the process proceeds to stepS402.

In step S402, the CPU 104 acquires information on contents displayed onthe setting screen 203, and stores the acquired information in the RAM106. The information on the displayed contents includes classificationinformation of texts, images, and the like, and information on detailedcontents (an image of a person or an image of an animal), for example.

In step S403, on the basis of the contents displayed on the settingscreen 203, the CPU 104 acquires information on the operation menu to bedisplayed, and stores the acquired information in the RAM 106. Withreference to FIG. 3 , for example, an image of a person is displayed onthe setting screen 203, and the CPU 104 acquires person-related items“red-eye correction” and “beautiful-skin processing” as operation menuitems to be displayed.

In step S404, the CPU 104 waits for the end of movement of the finger202. At the end of movement of the finger 202 (YES in step S404), theprocess proceeds to step S405.

With reference to FIG. 3 , for example, in a case where the movement ofthe user's finger 202 is stopped and the scroll operation is ended, theprocess proceeds to step S405.

In step S405, the CPU 104 acquires information on the contents displayedon the setting screen 203 when the movement of the finger 202 is endedin step S404, and stores the acquired information in the RAM 106.

In step S406, the CPU 104 analyzes a difference between the informationacquired and stored in the RAM 106 in steps S402 and S403 and theinformation acquired and stored in the RAM 106 in step S405. The CPU 104determines an operation menu to be updated on the basis of the change inthe setting screen 203 (the difference obtained by the analysis), andstores the information on the operation menu to be displayed on thesetting screen 203 in the RAM 106.

Specifically, with reference to FIG. 3 , a state of the setting screen203 is changed from the state of displaying the image of a person to thestate of displaying a text. Thus, the CPU 104 determines that theperson's face-related item “red-eye correction” is to be changed to thetext-related item “translation”, and stores the information on theoperation menu 302 in the RAM 106.

In step S407, the CPU 104 performs a control to display the operationmenu 302 stored in the RAM 106 on the display unit 109. In this way, theuser can select a desired operation menu item in accordance with thecontents displayed on the display unit 109.

In step S408, the CPU 104 determines whether the specific screen such asthe setting screen 203 is closed. In a case where the CPU 104 determinesthat the specific screen is closed (YES in step S408), the process inthe flowchart is ended. On the other hand, in a case where the CPU 104determines that the specific screen is not closed (NO in step S408), theprocess returns to step S401.

As described above, in the present exemplary embodiment, a control isperformed to display appropriate items on the display unit, on the basisof information before and after the user's operation. In this way, theuser's time and effort in selecting a desired function can be reduced.

In the present exemplary embodiment, in step S403, the CPU 104 acquiresan operation menu to be displayed on the basis of the displayed contentswhen the user's touch operation is started. However, this step may beomitted. In this case, in step S406, the CPU 104 analyzes the change inthe displayed contents on the basis of the information about thedisplayed contents at the start of the user's touch operation acquiredin step S402 and the information about the displayed contents at the endof the user's touch operation acquired in step S405. In response to thechange in the displayed contents, the CPU 104 determines the operationmenu to be displayed on the display unit 109.

In the present exemplary embodiment, the CPU 104 determines theoperation menu to be updated on the basis of the change in the settingscreen 203 (the difference obtained by the analysis). However, thepresent disclosure is not limited to this mode. The CPU 104 maydetermine the operation menu to be updated from only the contentsdisplayed on the setting screen 203 when the movement of the finger 202is ended in step S404, without analysis of the difference. Specifically,for example, the CPU 104 may determine the operation menu to be updatedon the basis of whether the contents displayed on the setting screen 203when the movement of the finger 202 is ended in step S404 are a text oran image. In a case where the contents displayed on the setting screen203 when the movement of the finger 202 is ended in step S404 are animage, the CPU 104 may determine the operation menu to be updated on thebasis of whether the image is an image of a person or an image of ananimal. The contents displayed on the setting screen 203 when themovement of the finger 202 is ended in step S404 may be determined usinga publicly known object extraction technique. For example, the publiclyknown technique may be Adaboost by which a strong discriminator iscreated from a plurality of weak discriminators or may be a deep neuralnetwork.

In the first exemplary embodiment, an example of processing in responseto a user's scroll operation on the setting screen 203 has beendescribed. In contrast to the first exemplary embodiment, in a secondexemplary embodiment, an example of processing in response to a user'soperation of enlarging a displayed object (hereinafter, pinch-out) or auser's operation of reducing a displayed object (hereinafter, pinch-in)on a setting screen 203 will be described.

An internal configuration of an information processing apparatus 101according to the present exemplary embodiment is similar to thatillustrated in FIG. 1 , and thus description thereof will be omitted.Herein, a case specific to the present exemplary embodiment, that is, acase where a change in displayed contents including a position of anoperation menu is required due to the enlargement/reduction operationwill be described.

Processing to be performed by the information processing apparatus 101according to the present exemplary embodiment will be described withreference to the flowcharts in FIGS. 5, 6, and 7 .

FIG. 5 is a diagram illustrating the behavior of a setting screen 203 inresponse to enlarged display by a pinch-out gesture. FIG. 6 is a diagramillustrating the behavior of the setting screen 203 in response toreduced display by a pinch-in gesture. FIG. 7 is a flowchart describingan example of procedure of processing to be performed by the informationprocessing apparatus 101 with the behavior illustrated in FIG. 5 or 6 .

With reference to FIGS. 5 and 6 , an operation menu 301 is displayedwhen a user's touch operation is started. However, the operation menu301 is not necessarily required to be displayed.

The processing in the flowchart of FIG. 7 is started on the conditionthat a specific screen such as the setting screen 203 is displayed on anapplication or the OS.

In step S701, a CPU 104 waits for the detection of movement of a user'sfinger 202. In a case where the CPU 104 detects the movement of thefinger 202 (YES in step S701), the process proceeds to step S702. Forexample, with reference to FIGS. 5 and 6 , in a case where a touchscreen display 201 is touched by the user with a plurality of fingersand the CPU 104 detects the movement of at least one of the fingers viaan input interface 102, the process proceeds to step S702.

In steps S702 and S703, the CPU 104 performs operations similar to thosein steps S402 and S403 in the first exemplary embodiment.

In step S704, the CPU 104 waits for the end of movement of the finger202. In a case where the CPU 104 detects the end of movement of thefinger 202 (YES in step S704), the process proceeds to step S705.

For example, with reference to FIGS. 5 and 6 , in a case where the CPU104 detects that the movement of the user's finger is stopped and thatthe pinch-in or pinch-out operation is ended (YES in step S704), theprocess proceeds to step S705.

In step S705, the CPU 104 performs an operation similar to that in stepS405 in the first exemplary embodiment.

In step S706, the CPU 104 analyzes the difference between theinformation acquired and stored in the RAM 106 in steps S703 and S704and the information acquired and stored in the RAM 106 in step S705. TheCPU 104 determines the operation menu to be updated on the basis of thechange in the setting screen 203 (the difference obtained by theanalysis), and stores the information on the operation menu in the RAM106.

Specifically, with reference to FIG. 5 , the CPU 104 stores the items“beautiful-skin processing” and “red-eye correction” in the RAM 106 instep 704, and the CPU 104 stores the image of the eyes in the RAM 106 instep 706 in response to the enlarged display of the image on the settingscreen 203. With reference to FIG. 5 , a part of an eye of the person isenlarged by the user's pinch-out operation. Thus, in step S707, the CPU104 determines that a human's eye-related item “red-eye correction” isto be displayed as an operation menu item (YES in step S707), and storesthe information on an operation menu 501 in the RAM 106.

With reference to FIG. 6 , the CPU 104 stores the items “beautiful-skinprocessing” and “red-eye correction” in the RAM 106 in step S704, and,the CPU 104 stores the image of the person and textual information inthe RAM 106 in step 706 in response to the reduced display of the imageon the setting screen 203. FIG. 6 illustrates a state in which the imageof the person and the text are displayed by the user's pinch-inoperation. Thus, in step S707, the CPU 104 determines the person-relateditems “red-eye correction” and “beautiful-skin processing” andtext-related items “translation” and “calendar registration” asoperation menu items, and stores the information on an operation menu601 in the RAM 106.

In step S707, the CPU 104 determines whether it is necessary to adjustthe display position of the operation menu based on the results of theanalysis in step S706.

In a case where the CPU 104 determines that it is necessary to adjustthe display position of the operation menu (YES in step S707), theprocess proceeds to step S708. On the other hand, in a case where theCPU 104 determines that it is not necessary to adjust the displayposition of the operation menu (NO in step S707), the process proceedsto step S709.

In step S708, the CPU 104 adjusts the display position of the operationmenu in accordance with the results of the analysis in step S706.

Specifically, with reference to FIG. 5 , because there is theinformation on the item “red-eye correction” in step S707, the CPU 104determines the position where the operation menu item “red-eyecorrection” is to be displayed based on the information stored in theRAM 106 in step S704. For example, because the “red-eye correction” isan operation menu item related to the person's eyes, for example, theCPU 104 determines the display position such that the operation menuitem is displayed at a position near the person's eyes and notoverlapping the display region of the person's eyes.

With reference to FIG. 6 , the operation menu items determined in stepS707 are the person-related items “red-eye correction” and“beautiful-skin processing” and the text-related items “translation” and“calendar registration”. Thus, the CPU 104 determines that the operationmenu items “red-eye correction” and “beautiful-skin processing” are tobe displayed near the person image and determines that the operationmenu items “translation” and “calendar registration” are to be displayednear the text.

In step S709, the CPU 104 performs a control to display the operationmenu items determined in step S707 on the display unit 109.Specifically, with reference to FIG. 5 , the CPU 104 performs a controlto display the operation menu 501, and with reference to FIG. 6 , theCPU 104 performs a control to display the operation menus 303 and 601.

In step S710, the CPU 104 determines whether the specific screen such asthe setting screen 203 has been closed. In a case where the CPU 104determines that the specific screen has been closed (YES in step S710),the process in the flowchart is ended. On the other hand, in a casewhere the CPU 104 determines that the specific screen has not beenclosed (NO in step S710), the process returns to step S701.

As described above, in the exemplary embodiment, the CPU 104 performs acontrol to display appropriate items on the display unit based on theinformation before and after the user's operation (for example, theinformation indicating whether the displayed contents are enlarged orreduced). In this way, the user's time and effort in selecting a desiredfunction can be reduced.

In the present exemplary embodiment, in step S708, the display positionof the operation menu is adjusted. However, the object to be adjusted isnot limited to the display position, and the display size of theoperation menu may be adjusted, for example.

In the present exemplary embodiment, the operation menu to be updated isdetermined on the basis of the change in the setting screen 203 (thedifference obtained by the analysis). However, the present disclosure isnot limited to this mode. The operation menu to be updated may bedetermined only based on the contents displayed on the setting screen203 at a point of time when the movement of the user's finger is stoppedand the pinch-in operation or pinch-out operation is ended, withoutanalysis of the difference. Specifically, for example, the operationmenu to be updated may be determined on the basis of whether thecontents displayed on the setting screen 203 are a text or an image at apoint of time when the movement of the user's finger is stopped and thepinch-in operation or pinch-out operation is ended. In a case where thecontents displayed on the setting screen 203 are an image at a point oftime when the movement of the user's finger is stopped and the pinch-inoperation or pinch-out operation is ended, the operation menu to beupdated may be determined based on whether the image is an image of aperson or an image of an animal. The contents displayed on the settingscreen 203 at a point of time when the movement of the user's finger isstopped and the pinch-in operation or pinch-out operation is ended maybe determined using a publicly known object extraction technique. Forexample, the publicly known technique may be Adaboost by which a strongdiscriminator is created from a plurality of weak discriminators or maybe a deep neural network.

Other Exemplary Embodiments

There are various available methods for displaying a menu in a casewhere the user performs both a pinch-put and a pinch-in while touchingon the screen. For example, it is assumed that the user touches thescreen with a plurality of fingers and then repeats a pinch-out and apinch-in to perform enlargement and reduction, and then releases theplurality of fingers from the screen.

In this case, the menu display may be changed in accordance with thecontents of the change in the screen during repetition of enlargementand reduction by a pinch-out and a pinch-in (before the release of thefingers) or the menu display may not be changed before the release ofthe fingers but may be changed after the release of the fingers.

In the former display method, the process is specifically executed asdescribed below. For example, in steps S401 and S701 described above, ina case where a pinch-out or a pinch-in is started, it is determined thata touch operation is detected. In steps S404 and S704, even though thefingers are not released, in a case where the pinch-out or the pinch-inis ended (that is, in a case where the movement of the fingers isstopped), it is determined that the touch operation is ended.

In the latter display method, the process is specifically executed asdescribed below. For example, in steps S401 and S701 described above, ina case where the screen is touched at a plurality of position, it isdetermined that a touch operation is detected. In steps S404 and S704,in a case where the fingers are released, it is determined that thetouch operation is ended.

The former display method has an advantageous effect that the user canperform a pinch-out or a pinch-in while checking the change in the menudisplay. On the other hand, in the latter display method, the change inthe displayed contents from the time of touch to the time of release isreflected on the menu display. Thus, for example, it is assumed that theuser enlarges the displayed contents by a pinch-in for enlarged display,and slightly reduces the enlarged contents for size adjustment withoutreleasing the fingers, for example. In this case, in the latter displaymethod, this operation is determined as “enlargement”, which produces anadvantageous effect that the menu can be displayed at the user's wishes.

The above-described two display methods may be changed in accordancewith the user's operation or may be changed in accordance with the typeof the displayed contents, for example.

In the above-described exemplary embodiments, the menu display iscontrolled in accordance with the enlargement and reduction of thedisplayed contents. Alternatively, the menu display may be controlledsuch that the menu is displayed only in response to the enlargement anddisappears in response to the reduction. In this case, because the menuis newly displayed in response to the user's enlarging an attentionregion in the screen, it is possible to inform the user of the presenceof the new menu in a clearer manner.

The present disclosure can also be realized by supplying a program forimplementing one or more functions in the above-described exemplaryembodiments to a system or an apparatus via a network or a storagemedium, and reading and executing the program by one or more processorsin a computer of the system or apparatus. The present disclosure can berealized by a circuit implementing one or more functions (for example,application specific integrated circuit (ASIC)).

Embodiment(s) of the present disclosure can also be realized by acomputer of a system or apparatus that reads out and executes computerexecutable instructions (e.g., one or more programs) recorded on astorage medium (which may also be referred to more fully as a‘non-transitory computer-readable storage medium’) to perform thefunctions of one or more of the above-described embodiment(s) and/orthat includes one or more circuits (e.g., application specificintegrated circuit (ASIC)) for performing the functions of one or moreof the above-described embodiment(s), and by a method performed by thecomputer of the system or apparatus by, for example, reading out andexecuting the computer executable instructions from the storage mediumto perform the functions of one or more of the above-describedembodiment(s) and/or controlling the one or more circuits to perform thefunctions of one or more of the above-described embodiment(s). Thecomputer may comprise one or more processors (e.g., central processingunit (CPU), micro processing unit (MPU)) and may include a network ofseparate computers or separate processors to read out and execute thecomputer executable instructions. The computer executable instructionsmay be provided to the computer, for example, from a network or thestorage medium. The storage medium may include, for example, one or moreof a hard disk, a random-access memory (RAM), a read only memory (ROM),a storage of distributed computing systems, an optical disk (such as acompact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™),a flash memory device, a memory card, and the like.

While the present disclosure has been described with reference toexemplary embodiments, it is to be understood that the disclosure is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

This application claims the benefit of Japanese Patent Application No.2022-072425, filed Apr. 26, 2022, which is hereby incorporated byreference herein in its entirety.

What is claimed is:
 1. A control method of an information processingapparatus, the control method comprising: specifying a changed displayedcontent in a case where a displayed content on a display is changed; anddisplaying a predetermined item on the display, the predetermined itembeing an item based on the specified changed displayed content and beingan item for performing a predetermined process using at least a part ofthe specified changed displayed content.
 2. The control method accordingto claim 1, wherein the predetermined item is an item based on a type ofan object included in the changed displayed content.
 3. The controlmethod according to claim 1, wherein in a case where the changeddisplayed content includes an image, an item for correcting the image isdisplayed as the predetermined item.
 4. The control method according toclaim 3, wherein in a case where the changed displayed content includesan image of a face, an item for making red-eye correction to the imageof the face is displayed as the predetermined item.
 5. The controlmethod according to claim 1, wherein in a case where the changeddisplayed content includes a text, an item for translating the text isdisplayed on the display as the predetermined item.
 6. The controlmethod according to claim 1, wherein the predetermined item specifiedbased on an object included in the specified changed displayed contentis displayed on the display, and wherein in a case where the specifiedchanged displayed content includes a first object and a second object, aplurality of predetermined items including the predetermined item basedon the first object and the predetermined item based on the secondobject is displayed on the display.
 7. The control method according toclaim 6, wherein the first object is an image and the second object is atext.
 8. The control method according to claim 1, wherein thepredetermined item specified based on an object included in thespecified changed displayed content is displayed on the display, andwherein a position where the predetermined item is displayed iscontrolled based on the object that is included in the changed displayedcontent and used for specifying the predetermined item.
 9. The controlmethod according to claim 8, wherein in a case where the specifiedchanged displayed content includes a first object and a second objectpositioned under the first object in the displayed content, a pluralityof predetermined items including the predetermined item based on thefirst object and the predetermined item based on the second object isdisplayed on the display, and wherein in a case where the first objectis positioned under the second object in the displayed content, thepredetermined item based on the first object is controlled to bedisplayed at a position under the predetermined item based on the secondobject.
 10. The control method according to claim 1, wherein thedisplayed content on the display is changed in response to apredetermined user operation.
 11. The control method according to claim10, wherein the changed displayed content is the displayed content whenthe predetermined user operation is ended.
 12. The control methodaccording to claim 10, further comprising acquiring the displayedcontent that is displayed when the predetermined user operation isstarted and the displayed content that is displayed when thepredetermined user operation is ended, and wherein the predetermineditem specified based on the acquired displayed content that is displayedwhen the predetermined user operation is started and the acquireddisplayed content that is displayed when the predetermined useroperation is ended is displayed on the display.
 13. The control methodaccording to claim 1, wherein a predetermined user operation is at leastany of scroll, pinch-in, and pinch-out.
 14. The control method accordingto claim 1, wherein the predetermined item specified based on an objectincluded in the specified changed displayed content is displayed on thedisplay, and wherein the object included in the specified changeddisplayed content is specified based on the displayed content that isdisplayed when a predetermined user operation is started and thedisplayed content that is displayed when the predetermined useroperation is ended.
 15. The control method according to claim 1, whereinthe predetermined item specified based on an object included in thespecified changed displayed content is displayed on the display, andwherein the object included in the specified changed displayed contentis specified based on AdaBoost or a neural network.
 16. An informationprocessing apparatus comprising: a specification unit configured tospecify a changed displayed content in a case where a displayed contenton a display is changed; and a display control unit configured todisplay a predetermined item on the display, the predetermined itembeing an item based on the specified changed displayed content and beingan item for performing a predetermined process using at least a part ofthe specified changed displayed content.
 17. A storage medium storing aprogram for causing a computer to execute a control method of aninformation processing apparatus, the control method comprising:specifying a changed displayed content in a case where a displayedcontent on a display is changed; and displaying a predetermined item onthe display, the predetermined item being an item based on the specifiedchanged displayed content e and being an item for performing apredetermined process using at least a part of the specified changeddisplayed content.